Testing Causality in Scientific Modelling Software

نویسندگان

چکیده

From simulating galaxy formation to viral transmission in a pandemic, scientific models play pivotal role developing theories and supporting government policy decisions that affect us all. Given these critical applications, poor modelling assumption or bug could have far-reaching consequences. However, possess several properties make them notoriously difficult test, including complex input space, long execution times, non-determinism, rendering existing testing techniques impractical. In fields such as epidemiology, where researchers seek answers challenging causal questions, statistical methodology known Causal Inference has addressed similar problems, enabling the inference of conclusions from noisy, biased, sparse data instead costly experiments. This paper introduces Testing Framework: framework uses establish effects data, users conduct software activities concerning effect change, Metamorphic Testing, posteriori . We present three case studies covering real-world models, demonstrating how Framework can infer metamorphic test outcomes reused, confounded provide an efficient solution for software.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Testing scientific software: A systematic literature review

CONTEXT Scientific software plays an important role in critical decision making, for example making weather predictions based on climate models, and computation of evidence for research publications. Recently, scientists have had to retract publications due to errors caused by software faults. Systematic testing can identify such faults in code. OBJECTIVE This study aims to identify specific ...

متن کامل

Scientific Software Testing: A Practical Example

Scientific applications perform numerical simulations of different natural phenomena in the filed of computational physics and chemistry, mathematics, informatics, mechanics, bioinformatics, etc. They are primarily developed for the scientific research community and usually they are used for simulating some I/O and data extensive experiments [Segal 2005]. The performance of such simulation expe...

متن کامل

Optimized Software Quality Assurance Model for Testing Scientific Software

Software projects in R&D organizations differ in their quality assurance process compared to other production and business organizations. Major hard constraints are accuracy and precision. Estimated number of defects the product is likely to contain at release shall be as minimum as possible. Various models for assessing the quality of the software are developed and are in use. The most widely ...

متن کامل

The Scientific Model of Causality

Causality is a very intuitive notion that is difficult to make precise without lapsing into tautology. Two ingredients are central to any definition: (1) a set of possible outcomes (counterfactuals) generated by a function of a set of ‘‘factors’’ or ‘‘determinants’’ and (2) a manipulation where one (or more) of the ‘‘factors’’ or ‘‘determinants’’ is changed. An effect is realized as a change in...

متن کامل

DDTS: A Practical System Testing Framework for Scientific Software

Many scientific-software projects test their codes inadequately, or not at all. Despite its well-known benefits, adopting routine testing is often not easy. Development teams may have doubts about establishing effective test procedures, writing test software, or handling the ever-growing complexity of test cases. They may need to run (and test) on restrictive HPC platforms. They almost certainl...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: ACM Transactions on Software Engineering and Methodology

سال: 2023

ISSN: ['1049-331X', '1557-7392']

DOI: https://doi.org/10.1145/3607184